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ABOUT THE INSTITUTE 



The Educational Policy Institute ( EPI) is sponsored by the Department of 
Educational Leadership and Policy Studies of Virginia Tech’s College of Human 
Resources and Education. The Institute is composed of faculty from a variety of 
departments on the Virginia Tech campus. Its purpose is to facilitate the distribution of 
information and to stimulate discussion of policy issues affecting public education and 
higher education in Virginia. The work of the Institute expresses the independent views 
and opinions of the researchers. They are not intended to represent the official comment 
or position of any elected or appointed official or any state agency. 

The mission of EPI is to: 

• Establish an organization devoted to educational policy research and service 
in the Commonwealth of Virginia and the nation, 

• Conduct research intended to inform educational policy makers, 

• Focus research interests of the faculty and graduate students on educational 
policy issues, and 

• Act as a service unit for educational policy groups such as the State Board of 
Education and the State Council of Higher Education for Virginia. 

EPFs most visible service to the Commonwealth of Virginia is its policy web site 
on which most educational policy issues and decisions are detailed and made available to 
anyone with access to the web. Faculty members and graduate students track the 
activities of the State Council of Higher Education as well as many activities of the State 
Board of Education. EPI also has chronicled the activities of the Governor’s Blue 
Ribbon Commission of Higher Education and also maintains the official web site of the 
Virginia Business Higher Education Council. 

Members of EPI have completed several research projects including a national 
study of the appointment and training of public college and university trustees, a national 
study of academic program approval and review processes by state coordinating and 
governing boards, and a study of the impact of the Campus Crime Awareness Act on 
student behavior. In addition, EPI faculty members have written policy papers on the 
Virginia’s Standards of Learning, quality in Virginia higher education, and performance 
funding in Virginia higher education. All of these research reports and policy briefs are 
available at no charge to interested persons. 

Those wishing to contact the EPI, should write or e-mail Dr. Don G. Creamer 
(dgc2@vt.edu), who serves as the Institute’s Executive Director or Dr. Steven M. Janosik 
(sjanosik@vt.edu), EPFs Co-Director at 308 East Eggleston Hall, Virginia Tech, 
Blacksburg, Virginia 24061. The Institute’s web site is: 

http://filebox.vt.edu/chre/elps/EPI/index.htm 
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FORWARD 



This monograph contains the invited papers of the major speakers at EPI’s 
International Conference on Quality in Higher Education held at Mansfield College, 
Oxford University in Oxford, England in the summer of 2000. The purpose of the 
conference was to discuss the how quality is being defined and measured in the context 
of higher education. 

Keynote speakers from three different countries were invited to share their 
thoughts on this topic with conference participants. Perspectives from Great Britain, the 
Netherlands, and the United States were included. Dr. Ian Aitcheson represented Great 
Britain and addressed the quality assurance assessment model currently in use in that 
country. Drs. Liesbeth van Welie represented the Netherlands and addressed some of the 
positive changes that can result from such processes and Dr. Jon Fife described a systems 
approach to quality management used by some institutions in the United States. 

In addition to these papers, Dr. Parker Marden addressed the difference between 
"training people for jobs" and "educating well-rounded, liberally educated citizens." He 
cautions readers about the dangers measuring the quality of higher education in an overly 
simplistic manner that might discourage institutions from attending to their "true" 
purpose. 

Dr. Elizabeth Creamer, in her paper on quality, equality, and equity, suggests that 
performance measures, often adopted as indicators of quality, should be examined 
carefully for unintended bias and that such bias may distort or marginalize the worth, 
value, or contribution of some persons when assessing quality. 

Ms. Barbara Johnson suggests that an important measure of quality for higher 
education should be the degree to which international perspectives are infused into the 
curriculum. She presents, in her paper, an effective model for internationalizing the 
community colleges through their staff development and course development activities. 

Drs. David Ostroth and Cathryn Turrentine address measuring the quality of 
service programs in student affairs in a paper entitled, “Focusing on Quality Through 
Program Review”. They also discuss the model for program review currently in use at 
Virginia Tech. 

Drs. Steve Janosik and Don Creamer discuss new trends in and methods for 
assessing the quality of distance education programs. They also address the shift in 
accreditation processes that are occurring because of this new teaching and learning 
delivery method. 

And finally, Dr. Marc vanderHeyden provides a written response to the issues 
raised and discussed during this weeklong conference. 
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The conference program and participant list are also included in this monograph. 
Additional information about EPI's Conference Series on Higher Education can be found 
at http://filebox.vt.edu/chre/elps/EPI/Oualitv/index.htm . 

Lastly, we want to thank David Martin for helping identify our international 
speakers and for his support while we were in England; Pat Bryant for her work with pre- 
conference arrangements; and Sandra Dika for handling so many of the conference 
details, developing our conference newsletters, and helping make the conference such a 
rewarding experience for everyone. 



S. Janosik 
D. Creamer 
M. D. Alexander 
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QUALITY ASSESSMENT OF UNDERGRADUATE DEGREE COURSES IN 

ENGLAND AND WALES 

Ian J.R. Aitchison 
Physics Department 
University of Oxford 



When David Martin asked me last 
week if I would be prepared to fill a gap 
in the program and talk to you on this 
subject, I had mixed feelings. Last 
November, the quality of the Oxford 
Physics courses was assessed by a panel 
of ten reviewers, set up by the Quality 
Assurance Agency (QAA). All 
departments in UK Universities 
(excluding Scotland) are subject to such 
reviews, as I shall explain in a moment. I 
was responsible for coordinating all 
aspects of the Oxford Physics 
Department's preparations for our review. 
We began in earnest in January 1998, and 
the job occupied me pretty well full-time 
from the summer of 1998 until December 
2000. I had, incidentally, my usual full 
teaching, research and administrative 
load as well: for example, I was in charge 
of undergraduate admissions at my 
College (Worcester). I was, however, 
dispensed from the duty of supervising 
two final-year physics projects, reckoned 
to be the equivalent of 16 contact hours. 
Perhaps this brief personal note already 
gives you some idea of the burden this 
process is imposing on University staff in 
the UK - and why I had mixed feelings 
about accepting David's invitation! 

Anyway, it is true that I am in a 
good position to tell you about the 
Subject Review Process run by the 
QAA. In part I shall inevitably draw on 
our Physics experience, but most of what 
I'll say is not subject-specific. 



I shall divide the talk into three 
sections: (1) existing forms of review, 

other than that of the QAA, (2) the QAA 
Subject Review, (3) retrospect and 
prospect. 

Existing Forms of Review Other Than 
That of the QAA 

I begin with this because one of 
the hotly debated issues in this area in the 
UK at the moment is whether the QAA- 
style review really does need to be so 
"heavy", given the existing review 
procedures (both internal and external) 
which many institutions already have in 
place. So let me list what we have here: 

1. The System of External Examiners. 
This is, I believe, required for all UK 
University degree courses. In Physics, 
for example, we have one External 
Examiner from another University, who 
normally serves for three years, and 
whose main functions are to monitor all 
assessment procedures, play a full part in 
the assignment of degree Classes (having 
particular regard to questions of 
comparability between different 
institutions), and comment on the courses 
generally. 

2. External Accreditations. This does 
not apply to all faculties, but in Physics, 
for example, the Institute of Physics 
regularly accredits (in a one-day visit) all 
UK physics degree courses. People 
holding accredited degrees can apply for 
the professional status of “Chartered 



Physicist.” Similar things exist in other 
disciplines, for example Engineering. 
The frequency is once every five years. 

3. Oxford General Board Review. A 
regular internal review of each 
department (e.g., “Physics”) is completed 
by the "Oxford General Board." The 
General Board is (still - the Oxford 
administrative structure is about to 
change!) the top academic body of the 
University, overseeing all Faculty 
Boards. The review frequency at present 
is once every ten years, but this is likely 
to become more frequent. 

4. External Advisory Committee. Finally, 
and this is not universal across all 
departments, though the University 
strongly encourages it, in Physics we 
have an “External Advisory Committee” 
composed of academics and industrialists 
whom we have invited to review both our 
teaching and research annually (in a one- 
day visit). 

Note that the preparation of 
documentation for both (2) and (4) is a 
significant job, and that the General 
Board review is pretty thorough, also 
requiring extensive preparation. 
Anyway, that is the background on top of 
which the Government's QAA review is 
currently superimposed. 

The QAA Subject Review 

What is the QAA, and what is it for? 

Under the 1992 Further and 
Higher Education Act, the Higher 
Education Funding Councils of England 
and Wales (HEFCE and HEFCW) were 
made responsible for securing the 
assessment of the quality of the education 
that they funded. In October 1997, the 



Councils transferred their quality 
assessment functions and staff to the 
QAA, which was established in April 
1997 as a private company limited by 
guarantee. The QAA is a registered 
charity; it has a board of directors drawn 
from the funding bodies, and independent 
members representing employers, 
professional bodies and industry. The 
main purposes of the Councils' 
contracting with the QAA for the review 
of quality in higher education were stated 
to be: 

• to secure value from public in- 
vestment, (i) by ensuring that all 
education funded is of approved 
quality (ii) by using subject review 
judgments to inform funding; 

• to encourage improvements in the 
quality of education, through the 
publication of subject review reports, 
and through the sharing of best 
practice; 

• to provide, through the publication of 
reports, public information on the 
quality of higher education. 

All the above, and full details 
concerning what I'll say in the rest of this 
section, are in the QAA's "Subject 
Review Handbook England and Northern 
Ireland September 2000-December 
2001", viewable at http://www.qaa.ac.uk/ 
public/srhbook/contents.htm. For our 
own review, we were working with the 
1998-2000 version of this Handbook. 

Note that the current program of 
QAA-based review is the first, and it 
ends in December 2001. I shall return 
briefly at the end of the talk to what may 
follow. 
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I draw attention to item (a) (ii), 
even though we do not yet have any 
experience of how these judgments are to 
be used to "inform funding." We do, 
however, have plenty of experience of 
how serious are the funding implications 
of the quinquennial reviews of our 
research activities (the "Research 
Assessment Exercise) - but that is beyond 
my scope this morning. 

Methodology 

The main features of the subject 
review method, as described in the 
QAA's Subject Reports (see 
http : //www .qaa. ac.uk) . are: 

(i) review is in relation to the subject 
provider's aims and objectives 

(ii) review examines student learning 
experience and student achievement 

(iii) review is by academic and 
professional peers 

(iv) a three-day review visit is carried 
out by a team of reviewers, that results in 
a graded profile of the provision, and an 
overall judgment 

(v) a detailed review report is published. 

The provision is analyzed in terms of six 
Aspects, 

Curriculum Design, Content and 
Organization 

- Teaching, Learning and Assessment 

- Student Progression and Achievement 

- Student Support and Guidance 
Learning Resources 
Quality Management and 
Enhancement 



Each is "marked" on a scale of 1 
to 4, going from 1 (“the aims and 
objectives [in this aspect] are not met; 
there are major shortcomings that must 
be rectified”) to 4 (“this aspect makes a 
full contribution to the attainment of the 
stated objectives. The aims set by the 
subject provider are met"). Thus the 
maximum score is 24. 

In the time available I can do little 
more than highlight what I consider to be 
some significant aspects of the process. 
First, note the language employed - for 
example, “subject providers.” Many of 
us are troubled by the increasing 
tendency to treat degree courses as 
commodities that are bought by students 
and sold in special supermarkets called 
Universities. Indeed, much of the 
“quality” rhetoric seems to derive from 
business values that, while not of course 
completely irrelevant, do not sit easily 
with a more liberal interpretation of the 
word “education.” 

When you are selling, say, 
specialized optical components (which 
happens to be my wife's business), your 
customers can reasonably expect you to 
be quite precise about the specifications 
of items in your catalogue, and how you 
ensure that the product is indeed “up to 
spec.” My wife recently paid a company 
1000 pounds to conduct a quality audit 
on her small enterprise, and to issue her 
(if all went well) with the appropriate 
quality certificate demanded in the 
industry. The procedure was simple: 
“say what you do, do what you say, and 
show how you ensure that it is in fact 
done.” These principles are fine as 
applied to things whose specifications 
can easily be measured, such as crystals 
for use in lasers. But is this approach 
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really what we want, when we are talking 
about educating human beings? 

The “measurement” mentality 
shows up in many ways. Take, for 
example, the “aims and objectives” 
which we have to produce (for the degree 
courses as a whole, and for each 
individual course component). Certainly, 
thinking about what you are trying to 
achieve, and how you would know 
whether you have done so or not, can be 
a useful exercise. But there is a problem: 
in the desire to state quantifiably 
measurable “outcomes” (another buzz 
word) one can easily reduce the richness 
and fullness of "education" to something 
much more akin to "training." One hears 
a lot about "skills" these days, especially 
"transferable" ones. This is all very well, 
but from the perspective of someone who 
works in a University that aspires to be 
world-class in both teaching and 
research, one has to ask if this kind of 
emphasis will foster those more creative 
talents on which high-level intellectual 
leadership depends. 

I believe that we may already be 
beginning to see, in our University 
entrants, signs that their teachers at 
school are being forced to concentrate on 
training them to get good grades, rather 
than on developing their deeper 
understanding. The same, and more 
widely generalized, “surface” approach 
may very well be engendered by the 
numerical scoring that the QAA has 
adopted (“out of 24”). Pre-QAA, the 
judgment was a much broader one: 
“excellent”, “satisfactory”, or “unsatis- 
factory.” 

To resume: the "aims and 

objectives" required in the QAA review 
are contained in a document that is 



constructed by the subject provider and is 
fundamental to the process. It is called 
the Self Assessment Document, and no 
one has missed the significance of the 
three initial letters. The format is strictly 
prescribed - for example, you have 250 
words for Aims and 500 for Objectives. 
Also in the SAD is the provider's own 
evaluation, with summarized evidence, of 
the quality of the education provided as 
measured against the stated A's and O's 
("are you doing what you say?"). The 
evaluation is set out under six headings, 
which are precisely those six Aspects of 
the Provision, listed above, in terms of 
which the provision is analyzed. This 
self-evaluation is limited to 4000 words. 
Clearly, every single word is a potential 
hostage to fortune - one quickly becomes 
paranoid about using words such as 
“excellence” and that is a pity... 

In support of the statements made 
in the SAD, institutions gather 
documentary evidence. In our case, it 
filled 140 standard (A4-sized) box files. 
The bulk of that was examples of 
students' work - on every course, 
showing varying levels of ability and 
indicating assessment procedures 
(formative or summative). You may find 
it difficult to imagine the labor involved 
in collecting that data, especially as far as 
the college (Tutorial) teaching side of our 
activities were concerned. With 
centralized faculty - delivered classes and 
labs, gathering such work samples is 
relatively straightforward. But in this 
peculiar University we have 30 
undergraduate colleges, all providing 
independent tutorials for the students, on 
top of the standard faculty 
provision. Much of it is done by faculty 
staff, of course - but still the actual 
logistics were pretty scary! 
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Inside the 140 box files there 
were about 350 folders, many of them 
containing several documents (e.g. the 
work of four students on one course in 
one week). Altogether well over 1000 
individual documents were assembled, 
many of them requiring a lot of effort to 
create. The boxes were then arranged, 
with a complete catalogue keyed to 
specific paragraphs (or even individual 
words) in the SAD, in the “Base Room”, 
the workplace of the review team during 
their 3-day visit. 

The Review Visit 

The SAD, and a limited amount 
of other “advance documentation”, are 
sent to the review team a few weeks 
before the visit. During the actual three 
days of the visit the team: 

• scrutinizes the documentation (in 140 
box files!), including external 
examiners' reports 

• samples student work 

• observes the various forms of 
teaching and learning being carried 
out 

• meets academic and admini- 
strative/support staff 

• meets students, former students and 
employers 

• considers the learning resources 

• constructs the graded profile and the 
overall judgment. 

Perhaps the most crucial events 
are several formal meetings at which one 



or more of the six Aspects are discussed. 
By the end of the visit, all will have been 
covered. At these meetings, members of 
the review team seek clarification of 
issues that have arisen as they have 
"followed a paper trail", and the 
institution has the opportunity to defend 
its practice where doubts have been 
raised. Quite precise protocols are laid 
down for the conduct of these meetings, 
including those with students. 

Perhaps I have said enough for 
you to judge for yourselves whether an 
evaluation in such a timescale is likely to 
be a realistic task for the reviewers, or 
perceived as fair by those reviewed. 
Nevertheless, it is the climax of over a 
year's work by a lot of people. 

Retrospect and Prospect 

By now I think you will have got 
the general idea of where I stand, on 
assessing these assessments! However, 
before coming to my remaining 
reservations, let me emphasize some 
more positive features. 

First, I believe we all accept the 
need for SOME form of “accountability”: 
after all, large sums of public money are 
being spent. Secondly, I have no doubt 
that the discipline of preparing ourselves 
for a searching external review of our 
undergraduate operations caused us: (a) 
to put in place some things that should 
have been there already (e.g. training 
sessions for non-faculty teachers, 
primarily graduate students), and (b) to 
accelerate the introduction of some 
desirable changes (e.g. the creation of an 
internal physics web with timetables, 
course notes, etc.). Furthermore, the 
whole exercise did (Momentarily? Per- 
manently?) raise the profile of teaching in 



a — frankly — research-dominated insti- 

tution. We also greatly improved the 
quality of the literature we produced for 
prospective applications, for incoming 
first-year students, and for those on 
course. And several aspects of the 
assessment procedures became a good 
deal more “transparent”, to us as well as 
to our students! 

But were these gains worth the 
effort of the cost? As to the latter, I 
would estimate that we spent about 
10,000 pounds EXCLUSIVE of 
academics' and other staff time. The 
exercise required very substantial 
diversion, away from other activities, of 
both secretarial and administrative staff, 
to say nothing of that of many academics. 
No funds were provided by central 
government to cover these costs, which I 
have probably seriously underestimated. 
A recent report, undertaken by PA 
Consulting for HEFCE and quoted in the 
Times Higher Education Supplement of 
August 25, 2000, states that the cost to 
the institution of a QAA review can 
range from 25,000 pounds to 200,000 
pounds, including staff costs - and I can 
well believe it. This report concludes 
that some 250 million pounds is being 
spent by UK Universities and Colleges in 
“accountability” activities, which 
represents some 4 per cent of the public 
funds they receive each year. Of this, the 
most burdensome activity in terms of 
direct measured costs (excluding un- 
attributed staff costs) is the QAA review, 
four times as expensive as the Research 
Assessment Exercise. The report finds 
that “the current [assessment] regime 
represents poor value for money.” 

Apart from the burdens of cost 
and time, there is also the question of the 
validity of the process itself. Here I have 



to say that we had some serious 
reservations. For example, at the first 
meeting to discuss one “Aspect”, 
conducted on the first day of the visit, 
much of “our side's” time was spent 
explaining where in the documentation 
the point raised was answered. Time 
spent by the review team in familiarizing 
themselves with the cataloguing scheme, 
and in reading more of the documents 
before asking questions, would have 
resulted in a much more productive 
session. This was all the more evident 
when many matters under the same 
Aspect were raised by the review Chair in 
a meeting with me on the morning of the 
final day, in reply to which I had to 
prepare written responses to no fewer 
than seven specific queries, between 11 
a.m. and 1 p.m. This was clearly at 
variance with the QAA's own guideline 
timetable for the visit, and left us feeling 
very frustrated, and disinclined to believe 
that some aspects, at least, of the 
judgment pronounced at 4 p.m. that 
afternoon had been fairly arrived at. 

We were also very disappointed 
by the behavior of one reviewer, who 
occasioned independent written 
complaints from two of our students. I 
had issued all students with the protocols 
for the meetings, and this reviewer 
breached them quite blatantly, giving 
clear evidence of serious bias. This was 
bad enough: what made it far worse was 
that the QAA, itself the supposed 
guardian of quality in procedures, turned 
out to have no procedure at all for dealing 
with complaints concerning a reviewer's 
conduct during a visit, not even when it 
clearly revealed serious bias. 

What will we be faced with in the 
new cycle that begins in 2002? It is hard 
to read the signs. On the one hand we 
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hear vague promises that next time there 
will be a “LIGHTER TOUCH”, perhaps 
focusing on the deficiencies noted this 
time, and better integrated with the work 
of External Examiners and professional 
bodies. There is also increasingly open 
criticism (see the THES article quoted 
above) of the costs involved, both 
financial and in terms of absorption of 
staff time and other resources away from 
the Universities’ “core business”, namely 
teaching and research. But on the other 
hand we already know that the next QAA 
review cycle will involve “bench- 
marking.” To me, this is very worrying, 
and illustrates the kind of slippery slope 
on which we are sliding. It is central to 
the current review cycle that providers 
are assessed relative to their own stated 
Aims and Objectives. The scores are not 
meant to be used in any comparative 
way, other than to see how well 
institution A lived up to its A's and O's as 
compared to institution B, which may 
have had quite different A's and O's. But 
of course this has resulted in many “top” 
institutions scoring less well than some 
far lower in the traditional academic 
pecking order. And so there is an 
inevitable call for some kind of across- 
the-sector standard, or benchmark, 
subject by subject. The one for Chemistry 
has been produced already and a 
committee is being set up to do one for 
Physics, and so on and so on... 

Will not such a regime be even 
worse? Are we looking at a National 
Curriculum at University level? 
Contemplating that kind of future, I am 
wonderfully comforted by the reflection 
that I shall retire in 2003. 



Biographical Sketch 

After graduation from Cambridge 
University with a B.A. in Mathematics 
and a Ph.D in Theoretical Physics, Ian 
Aitchison worked for two years as a 
postdoctoral research associate at 
Brookhaven National Laboratory, Long 
Island, N.Y. This was followed by a year 
at the Saclay Laboratory near Paris, and 
two years back in Cambridge, where he 
was Director of Studies in Mathematics 
at Clare College. He then took up a 
faculty position in the Oxford University 
Physics Department, where he has 
remained for longer than he cares to 
admit. He has spent sabbatical leaves as 
Visiting Professor at the Universities of 
Toronto, Rochester, and Washington, and 
as a Visiting Associate at the European 
Center for Nuclear Research (CERN) in 
Geneva. He is currently working on the 
third edition of a graduate level text on 
particle physics. 

Ian met his wife, Jean, when they 
were both working at Brookhaven (she in 
the Biology Department), and they were 
married in Riverside Church, New York. 
They have two daughters - one is a 
Psychiatrist in London, and the other 
obtained her Ph.D. in Russian Literature 
from the University of Michigan at Ann 
Arbor. Some years ago, Jean's folks 
joined many of their fellow Chinese 
American friends in exchanging the 
rigors of the Manhattan climate for the 
milder air of Northern California. Jean 
and Ian have a house in Mountain View, 
near Jean's mother in Palo Alto, and they 
look forward to spending more time there 
after Ian's retirement from Oxford. 



WALK ON AIR DO WE? 



Drs. Liesbeth A.A.M. van Welie 
Senior Vice President for University Advancement 
Universiteit van Amsterdam 



*Walk on air do we? And how! 

With the panther 's pad, with his lightness 
Never did members conspire till now 
In such whole gladness. 



*W.H. Auden, To Gabriel Garrit, 
Captain of Sedbergh School XV, Spring 1927 



The Dutch national system for 
quality assessment of teaching in higher 
education was introduced in 1986. Each 
course is visited and assessed by a team 
of peers every five to six years. The third 
cycle is now in progress. 

In this lecture will be illustrated 
and discussed how this system of quality 
assessment has changed the attitude of 
universities and academic staff in a 
positive way. 

Nowadays at the Universiteit van 
Amsterdam even more sophisticated 
procedures for the advancement of the 
quality of teaching, research and 
governance have been initiated by the 
Executive Board and the deans. 

Comparable trends can be seen at 
other European universities. Especially, 
the example of Spain will be discussed. 

The debate on quality seems to be 
dominated by contradictions: autonomy 
versus accountability, decentralization 
versus strategic centralization, and 
academic freedom versus market 
steering. Are these real contradictions? 
Or are we experiencing a long period of 



re-enforcement of universities after the 
“identity crisis” of the 1960s? 

The Dutch System of Assessing the 
Quality of Teaching and Research 

The Quality of Teaching 

The Dutch program for 
assessment of the quality of teaching was 
launched in 1986. By that time all 14 
— Dutch universities were organized in the 
newly founded VSNU — the Association 
of Universities in the Netherlands. 
Originally, the Minister of Education had 
planned to give his Inspectorate the 
responsibility for carrying out the 
national assessment program. The 
universities united themselves in the 
VSNU because they wanted to organize 
this quality program themselves, under 
final authority of the Minister. The 
Inspectorate was given responsibility for 
the so-called meta-evaluation, that is, the 
evaluation of the procedures for 
assessment as such. 

In its own words, the principal 
goal of the VSNU is to represent all 
Dutch universities and strengthen their 
position in society. For this purpose: 



• “the VSNU represents the interests of 
the universities vis-a-vis political, 
governmental and community 
organizations; 

• the VSNU is an employers’ 
organization that negotiates with the 
government and with employees’ 
organizations regarding the working 
conditions of university employees; 

• the VSNU develops activities to 
provide services for its members.” 
(Universities in the Netherlands, 
VSNU, 1999). 

A review committee of peers and 
a representative of the related 
professional world outside the university 
visit each study program every six years. 
All Dutch universities with a particular 
study program are visited at the same 
time. Thus comparison - besides 
evaluation, advice and accountability to 
society - is one of the goals. 

The evaluation is primarily based 
on a self-study report that is written 
according to an extensive checklist. Of 
course, information about the contents of 
the curriculum, the quality and standard 
of examinations, results and the number 
and quality of dissertations are among the 
topics that have to be covered in this 
report. 

The review committee usually 
stays for two days. At the end of the visit, 
the committee discusses its impressions 
and findings with the dean, several 
professors and the vice-chancellor. The 
written report of the committee is made 
public. 



The Effect of the Evaluation of Teaching 
on Academic Staff 

While the third cycle of quality 
review is in progress, a considerable 
change can be seen in the attitude of 
academic staff towards external 
evaluation. Whereas in the first years 
from 1986 on, feelings were defensive 
and somewhat insecure, today academic 
staff is critical about the system because 
they feel it is becoming a bit obsolete. 
Their demands on quality assessment are 
more specific, more ambitious, more 
tailor-made and for less “middle of the 
road” advice. They want to choose for 
themselves the university with which 
they would like to be compared regarding 
their specific discipline. Another point of 
criticism is that the differences between 
universities are very small (tenths of 
points on a ten-point scale) while the 
media tend to base a ranking system on 
these small differences in a rather 
absolute way. In response to these 
criticisms, the Universiteit van 
Amsterdam has developed its own, more 
advanced procedures for quality 
improvement, which will be discussed in 
a moment. 

Besides the obvious result that the 
national program for evaluation has 
helped to put teaching on top of the 
education agenda, one can also observe 
concrete effects. New initiatives have 
been developed as a result. The 
Universiteit van Amsterdam, for example, 
has developed several new 
interdisciplinary first-year courses, 
introduced the possibility of major/minor 
qualifications for students, and built an 
extensive co-operative network with 
secondary education to improve access 
and the allocation of students to the study 
program that fits them best. 
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The Quality of Research 

More than teaching, research has 
of course a long tradition of continuous 
international judgement by peers. 

In terms of productivity and 
quality, the research carried out at Dutch 
universities ranks among the world’s top 
ten. Dutch universities have a leading 
role in research, in contrast to, for 
example, the Scandinavian countries, 
France, Germany and the United 
Kingdom, where a substantial part of 
research is done in research institutes 
outside the university. 

In the Netherlands, the total 
expenditure in 1998 on research was 14 
billion guilders, which amounts to 2% of 
the country’s gross domestic product. 
There are three main sources of funding: 

• The Ministry of Education, Culture 
and Science - 56% 

• The Netherlands Organization for 
Scientific Research (NWO) -17 % 

• Contract research - 27% 

These three sources of funding 
use different procedures for assessing 
quality. The VSNU evaluation of 
research differs from the evaluation of 
teaching in several aspects. Research 
evaluation is institution-wide but 
disciplinary based, and is carried out by 
an international committee of peers. 
Subject to assessment are, among other 
issues, productivity, standards in 
international comparison, societal 
relevance and long-term prospects. An 
assessment of policy and management of 
research is optional (Association of 
Universities in the Netherlands, 1999). 



The assessment by the 
Netherlands Organization for Scientific 
Research (NWO) is more based on 
organizational units (as opposed to being 
university- wide) and more tailor-made. 
NWO also advises the Minister in the 
selection of a small number of elite 
research schools and institutes. 

Another important player in the 
field is the very prestigious Royal 
Netherlands Academy of Arts and 
Sciences (KNAW). It offers awards and 
scholarships to very talented young 
scientists. The Academy accredits top 
research schools for postgraduate 
research training. It makes its expertise 
available for the assessment of research. 

Some Subsequent Trends in Research 

As in teaching, research scientists 
have themselves placed further demands 
on the procedures for evaluation. This 
trend is reinforced by endless budget cuts 
by the Ministry of Education. The 
percentage of contract research is steadily 
growing year by year, and competition 
for funding is motivating scientists to 
have their work thoroughly assessed. 
Fund-raising and philanthropy, long 
known phenomena in the United States, 
are now the focus of attention at several 
Dutch universities. This rather new 
financial resource for universities will 
introduce further procedures for quality 
assurance. 

One can argue that some of the 
most innovative or even spectacular 
research is done at the boundaries of 
disciplines. In the eyes of many people in 
academia, the interdisciplinary approach 
is a value in itself, or - to use a metaphor 
from my own discipline, biology - the 
greatest richness of species can be found 
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in the border area between two biotopes. 
Since contract research is often 
interdisciplinary - because of its applied 
nature or required societal relevance - 
new incentives and the organization of 
research should foster interdisciplinary 
research (A.Nieuwenhuijzen Kruseman, 
2000 ). 

However, this is not the case; on 
the contrary, there seem to be several 
circumstances that tend to stabilize 
mono-disciplinary research. Most 
prestigious scientific journals and elite 
research institutes are disciplinary based. 
The same can be said of the research 
schools and institutes at Dutch 
universities. In the early 1990s, the 
Minister of Education introduced his 
plans to establish a few top research 
schools, to stimulate competition and the 
pursuit for highest quality in an 
international environment. Developments 
in the last decade, however, have turned 
out to be quite different from what had 
been planned: practically all research has 
become organized in research schools 
and institutes, which has restricted a 
flexible, thematic or interdisciplinary 
approach. Recently the original idea was 
presented again, but adapted to the new 
reality: six top institutes are selected by 
the above-mentioned NWO as centers of 
excellence. 

In my opinion, one of the 
challenges for the near future is to 
identify incentives for interdisciplinary 
teaching and research. 

Governance for Quality: Innovative 
Changes at Universiteit van Amsterdam 

The change of attitude of 
universities towards external quality 
assessment in the past decade has focused 



on and inspired the debate about 
leadership and governance of 
universities. Evolving more and more 
explicit ambitions, in terms of continuous 
quality enhancement, have given much 
more clear and rational dimensions to 
visions on such a conceptual idea as 
leadership. How should governance be 
redesigned to foster these ambitions? 

Supported by the 1995 act on 
higher education — which gave 
universities a far larger possibility to 
make their own choices regarding their 
internal organization — the Universiteit 
van Amsterdam has implemented some 
very profound changes. 

The starting point for this process 
was the question on how to balance the 
wish for further decentralization of 
responsibilities to the faculty* on the one 
hand, and reinforce strategic institutional 
planning on the other hand. The general 
motivation behind decentralization was to 
bring responsibility for financial policy- 
making and accountability for results 
closer to the level where the money is 
actually spent. But the Board also wanted 
to reduce the constant insecurity caused 
by procedures that require faculties to 
apply or compete for a budget each year. 
One year was seen as too short a period 
for strategic and efficient planning. 

The precondition for this 
decentralization, however, was the 
establishment of a stronger, more 
professional leadership at faculty level. 
After clustering faculties into far larger 
entities, the former elected deans were, 
after their term had finished, replaced by 



* “Faculty” is a confusing term. It means 
“academic staff’ in the USA and “department” 
(as in department of biology) in the Netherlands. 
In this text the word is used in the second sense. 



professional deans appointed by the 
Board - though it must be admitted that 
by then nobody had figured how hard 
(and expensive) it would be to find such 
deans! They were brought in from the 
World Bank in Washington, and CERN 
Geneva, to mention just two examples. 
With the appointment of professional 
deans, the system of a yearly budget was 
replaced by a four-year covenant, 
negotiated by the dean and the Board, 
and based on a self-study report and a 
strategic development plan presented by 
the dean. (Acherman, 1998). The Board 
also increased the percentage of total 
expenditure earmarked for innovation 
and improvement, and reduced the fixed 
budget for basic financing. The Board 
and the dean have a yearly evaluative 
meeting on the progress that has been 
made. 

Of course, more extensive 

freedom and responsibility and more 
sophisticated accountability come in 
pairs. Therefore the deans and the Board 
together implemented a new system for 
the internal quality measurement of 
governance, management, financial 

management, and policy-making, which 
in several aspects is more critical (and 
more tailor-made anyhow) than the 

national system. Every four years, each 
faculty is visited by a team of specialists, 
consisting of colleagues from another 
faculty within the university and 
colleagues from another university, 
mostly from abroad, who are considered 
to be at the top level within the 
discipline. 

At the institutional level, a 

controller was appointed to further 
develop and monitor the quality and 
efficiency of financial management 
procedures at the faculty and central 



level. His goal is to make financial 
management more strategic compared to 
the rather bureaucratic and standardized 
budgeting procedures of the past. 

Another effect of the growing 
emphasis on continuous quality 
management is that it convinced 
academia that a redesign of the 
organization of teaching and research was 
necessary. Especially teaching required a 
more supportive and stimulating 
environment than the loosely coupled 
culture characteristic of many 
universities. All teaching and research is 
now organized within institutes, with a 
professor at the head of each institute. 
These appointments have given an 
enormous impulse to the development of 
academic leadership. At present it is 
under debate whether these directors 
should have additional responsibility and 
independence in terms of finances and 
policy-making. 

Another European Example 

These issues are in one way or 
another, and of course in different 
contexts, influencing strategic policy- 
making at most European universities. 
The balance between stronger 
institutional strategies and decentral- 
ization is one of the especially dominant 
issues. For instance, developments in 
Norway concerning the redefinition of 
academic leadership, a clear description 
of the responsibilities of the dean and the 
rector, and the description of academic 
and administrative effective policy and 
decision-making, is to a large extent 
comparable to developments in the 
Netherlands (Michavila, 2000). 

I have however chosen to 
elaborate on the example of Spanish 
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higher education for several reasons. 
When I learned to speak Spanish a few 
years ago it was like getting a passport to 
a new and very exciting world, since 
universities in the Netherlands tend to be 
very UK- and US-oriented. Since my 
introduction into the world of Spanish 
and Latin American universities, I use 
developments in these universities as a 
resource for new ideas and good practice. 
The reason for this could be that there are 
several new universities in Spain that had 
the opportunity to design their 
organizational structure from scratch. 
Therefore they can explain very well why 
they made their choices on human 
resources management, quality 
management and academic ambition in 
direct relation to present societal 
demands. The Politecnica de Catalunya 
(UPC), with its strong regional focus, 
could be an example for many other 
European universities, since trends seem 
to point at a stronger emphasis on 
regionalism in a more united Europe on 
the national level. They also are ahead of 
many other universities in the ways they 
have established a “hybrid” organization, 
with strong co-operation with the world 
of business and industry and the fostering 
of classical academic values at the same 
time. Finally the fact that several 
countries in the Spanish-speaking world 
have undergone sudden and profound 
political changes in recent history 
influences developments in a specific 
way. In the US and most European 
countries, the concept of academic 
freedom was in fact self-evident. 
Freedom of speech is a constitutional 
right and anyone in academia who should 
be obstructed in his/her pursuit of good 
and truth in research or teaching, could 
appeal for justice in a democratic system. 
The gift of freedom and democracy is in 
the living memory of the people of Spain. 



This seems to give their discussions on 
an apt translation of academic freedom 
for society in our present time, more 
inspiration and creativity. 

What does this mean for 
procedures for assessing quality and for 
governing for quality? The example I 
have chosen - the Politecnica de 
Catalunya -has in the concept of the 
“learning organization” taken strong 
leadership in the development of its own 
processes and procedures for quality 
enhancement. 

In 1998 the Rector, Jaume Pages, 
presented his program for re-election, 
which in itself is unusual in academia. As 
his priorities for his next four-year term 
at UPC, he selected: 

• An analysis of the organizational 
structure of UPC, especially the 
balance between centralized and 
decentralized responsibilities; 

• A comparative study of organ- 
izational choices in universities in 
other countries, in order to inspire 
debate and support planning at UPC. 

(Michavila, 2000) 

Subsequent Proposals for Further 
Decentralization and Realistic 
Process Design 

His earlier agendas included 
human resources management, teacher 
training, the balance between research 
and teaching, quality assessment 
procedures and service to society. Over 
the past years, I have had the privilege of 
reading many operational policy 
documents concerning the implemen- 
tation of these ambitions, and have 
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participated in workshops and seminars 
organized by UPC to facilitate 
institutional learning. 

This strong internalization of 
measures for quality enhancement, 
organizational translation of goals as well 
as choices in terms of leadership style, 
put into perspective in my opinion the 
trends and responses to the national 
system for quality assessment in the 
Netherlands. 

Discussion 

The discussions on the function 
and characteristics of universities in this 
new millennium seem to be dominated by 
contradictions: 

• Centralisation versus 
decentralization; 

• Academic freedom versus context or 
market steering; 

• Government funding as a perception 
of independence (from the market) 
and of dependence, or too little 
autonomy; 

• Leadership as a corpus alienum 
(every professor is his/her own 
leader) and the demand for inspiring 
and efficient leadership. 

I want to argue that these 
contradictions are mostly false and 
unnecessarily paralyse the debate. 

In the context of rapid and 
constant changes in the environment of 
universities, adaptability and flexibility 
are critical success factors, as is diversity 
in study programs, especially in the 
context of lifelong learning. This 



adaptability requires continuous 
professional analyses of trends and 
societal demands, resulting in planning 
for the university as a whole. It is my 
opinion that strategic planning should be 
centralized. The actual innovation and 
change of teaching and research 
flourishes best in an environment where 
academic leadership on the departmental 
level is aimed at creating a supportive 
and inviting environment for the 
enormous resource of individual talents, 
in the best and oldest tradition of 
academia. The plea for decentralization 
of financial responsibilities is based on 
the assumption that accountability for the 
budget should be at the level where the 
money is actually spent. This fosters 
flexibility and reduces the growth of 
bureaucracy of general and too 
conservative budgeting. 

Since there are fine examples of 
universities that are predominantly client- 
or market-driven (distance learning, the 
virtual university, international 
franchised institutes), without any doubts 
as to their academic standards, it can 
easily be demonstrated that market 
influence in itself is not a threat. Is it a 
matter of trust that academia is old and 
strong enough and therefore never will be 
“sold out” (Gines Mora, 2000)? 

Of course, any government will 
make a university accountable for the 
expenditure of government money. It is 
up to each individual university to decide 
to what extent it will be dependent on 
government funding. European 
universities are sometimes reluctant to 
seek new financial resources; fund- 
raising and philanthropy are relatively 
new phenomena. Since dependence on 
government funding often seems to be 
limiting possibilities for research, why 
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not view contract research and 
philanthropy as an enhancement of 
academic freedom? 

The substantial growth and 
professionalization of administrative and 
bureaucratic management over the past 
decades is certainly a problem, and has 
caused an unwanted separation between 
administration and academia at many 
universities. Governance as a career path 
for professors has long been neglected in 
Europe. Universities that have appointed 
professors rather than administrators to 
key positions - and this includes the 
Universiteit van Amsterdam — are very 
positive about the results. 
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What is meant by the word 
quality? Most people think they know 
what quality is when they see it but few 
know how to define it. The simplest and 
most often used definition of quality is 
that it is a perception of the degree that an 
item, service or organization is able to 
meet or exceed the expectations of 
another person. For higher education, the 
simplicity of this definition raises several 
very complex questions: Who are the 

people that a higher education institution 
needs to be concerned about when 
assessing quality? How, and in what 
ways, have their expectations for higher 
education changed? What must an 
organization, as complex as a higher 
education institution, do to ensure that it 
will meet the expectations of these 
people? What type of an organizational 
framework would promote a quality 
culture? And finally, what processes 
currently exist that can be used to help an 
institution monitor and improve efforts to 
produce consistent quality results? 

This paper will address each of 
these questions. First, this paper will 
identify who helps define if a higher 
education institution is a quality 
institution and review how their changing 
expectations now are such that higher 
education institutions no longer have an 
option whether or not to institute quality 
systems within their institutions. Second, 
the principles of a quality system will be 
examined from both their inter- 
relationships and their compatibility with 
the values that have made American 



higher education so successful. Third, an 
organizational framework or perspective 
that could be used to promote a quality 
culture will be reviewed. And finally, two 
quality assessment processes will be 
analyzed to see how they can be used to 
help higher education institutions 
evaluate and improve their efforts to 
create their own quality culture. The 
overall purpose of this paper is to provide 
a new way for higher education 
organizations to think about their current 
values and directions and how they might 
use an approach that has proven to be 
more effective in helping both 
individuals and organization achieve 
what they have intended to achieve. In 
other words, this paper is intended to help 
individuals and organizations create a 
systematic approach to fulfilling their 
personal and institutional missions 

Stakeholder Satisfaction 

The first step to understanding 
how to define and improve the quality of 
an institution is to understand who has 
the greatest influence on making the 
collective decision that “This is a quality 
institution!” The business sector used to 
define quality as meeting the expectations 
of their customers and a customer as 
anyone who buys and uses their goods or 
services. Increasingly, this simple 
concept of quality as solely being 
measured by customer satisfaction is 
being seen as inadequate in producing an 
overall quality organization because it 
does not include the indirect customer 



who has a stake in how an organization 
performs. Examples of these indirect 
customers would be employee unions 
that are concerned with fair wages and 
benefits, the surrounding neighborhoods 
of the organization that are concerned 
with pollution, or state and federal 
regulatory agencies who are concerned 
with fair trade or employee safety 
standards. Thus, more frequently the 
narrow concept of customer satisfaction 
is being broadened to the more inclusive 
concept of stakeholder satisfaction. 

To understand who the 
stakeholders of a higher education 
institution are, it is necessary to 
understand who gave permission for an 
institution to exist, who financially 
supports the institution, who are 
primarily responsible for the outcomes of 
the institution, and who receive and 
benefit from these outcomes. For all 
higher education institutions, it was a 
state that granted a charter or corporate 
status to the organization to provide 
educational activities because these 
activities benefited society. There has 
always been an implicit understanding 
that as society’s needs changed so should 
an institution’s response to meet these 
needs. Examples of stakeholders who 
help to financially support an institution 
would be state legislatures, parents and 
students, foundations, federal 
government agencies, student aid 
programs, and alumni. Examples of 
stakeholders responsible for an 
institution’s outcomes are the faculty, 
student affairs staff, students, and the 
administration staff. Finally, examples of 
stakeholders who benefit from or have a 
stake in the outcomes of an institution 
would include parents, employers, and 
society in general. Collectively, it is the 
extent to which an institution has met the 



expectations of these stakeholders that 
determines and defines its overall quality. 

Toward the Quality Movement in 
Higher Education 

Over the past 60 years a number 
of events have occurred that have 
changed the expectations of the 
stakeholders of higher education 
institutions that now result in an external 
demand that higher education institutions 
develop a more systematic approach to 
ensuring the quality of their performance. 
Three of the most critical events are 
described below. 

Creating a National Value for 
Universal Access 

The two decades that followed 
World War II were the incubation years 
that created the values and attitudes 
towards higher education that are 
producing today’s public pressures for 
the adoption of quality processes in 
higher education. These were the years 
in which the nation began to understand 
the role that higher education could play 
in social and occupational mobility. At 
least for the middle class, family values 
were changing so that their children’s 
attitudes toward going to college moved 
from an aspiration to an assumption. 
There were two major events that 
precipitated this change. 

The first was the creation of the 
G. I. Bill. Having learned from the 
country’s negative experience of the 
returning World War I veterans’ impact 
on the workforce and its economy, it was 
the intention of Congress to use the G. I. 
Bill to delay the impact of the returning 
soldiers on the marketplace until it could 
absorb this vast influx of manpower. 
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This Bill was enormously successful in 
accomplishing its prime objective as 
thousands of soldiers took advantage of 
the college tuition benefits of the G. I. 
Bill. There are four long-term impacts 
this Bill had on the nation’s attitudes 
towards higher education that were not 
expected: (a) it provided opportunities for 
a great number of people to go to college 
who never had dreamed this was 
possible; (b) it provided strong evidence 
that a greater number of people than went 
to college in the past could benefit from a 
higher education; (c) it greatly increased 
the enrollments in public institutions; and 
(d) it legitimized a federal role, not 
provided for in the U. S. Constitution, in 
providing funding a higher education 
(Olsen, 1968). 

During this time, the 1946 Zook 
Commission (also known as the Truman 
Report) made two recommendations that 
foretold significant changes in American 
higher education. The Commission 
recommended that no one should be 
denied a higher education because of 
their economic status. It furthered 
recommended that there be established a 
system of two-year colleges that were 
low cost and sensitive to the 
community’s education needs (Kerr, 
1983). These two events helped spur the 
equal education opportunity values that 
were to guide American higher education 
into the 21 st century and with this came 
greater concern over higher education 
institutions meeting the education needs 
and expectations of this more diverse 
student clientele. 

Recognizing Higher Education as a Vital 
Link to a Politically and Economically 
Strong Society 



The launch of the Russian 
satellite, Sputnik, sent the U.S. into a 
state of panic. There was fear that the 
U.S. was going to lose the Cold War and 
a greater concern over the effectiveness 
of American higher education. In 1958 
the National Defense Student Loan 
(NDSL) program was formed to both 
provide, for the first time, federal student 
aid to American youth who were not 
military veterans, and through its 
repayment forgiveness clause, helped 
direct students into specific occupations, 
such as teaching and the sciences. The 
Higher Education Act of 1965, and its 
amendments in 1972 and 1979, further 
increased the federal role in the support 
of higher education and open access. The 
National Student Loan Program (NSLP) 
was established in 1965 and in 1972 the 
Basic Educational Opportunities Grants 
(BEOG), now titled the Pell Grants, was 
created (Schulman, 1979). The growth of 
these programs has been phenomenal, 
with the BEOG program growing from 
$145 million in 1972 to nearly $6 billion 
in 1999 and thus helping to fulfill the 
Zook Commission’s recommendation of 
decreasing the financial barrier to higher 
education. With this increased public 
support of higher education along with a 
greater number and diversity of students 
came a greater demand for institutional 
accountability. 

Moving from Faith- to Fact-based 
Support of Higher Education. 

Prior to 1940, so few people had 
gone to college, the vast majority 
accepted the performance of higher 
education institutions on faith. One of 
the consequences of the G. I. Bill and the 
following student financial aid programs 
was that there was an increase in the 
number of families who experienced 
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higher education. Often they did not feel 
that they had received a reasonable return 
on their financial and time investment. 
Books like ProfScam: Professors and the 
Demise of Higher Education (Sykes, 
1988), Cultural Literacy: What Every 
American Needs to Know (Hirsch, Jr., 
1987), and Impostors In The Temple: 
American Intellectuals Are Destroying 
Our Universities and Cheating Our 
Students of Their Future (Anderson, 
1992) became best sellers and the 
darlings of the media. The result of this 
discontent gradually appeared in state 
legislative action. The most prevalent 
legislative response was to link state 
support with institutional performance. 
By 1998, a majority of the 50 states had 
instituted legislation that tied funding 
with performance measures. 

An example of a prevailing 
attitude towards holding higher education 
to a greater level of accountability are the 
recommendations from the Blue Ribbon 
Commission on Higher Education 
established by Governor George Gilmore 
of Virginia. Central to its 73 
recommendations was an Institutional 
Performance Agreement that provides 
each institution with multi-year funding 
in return for agreed-upon performance 
standards addressing academic quality 
and operational efficiency. In his 
acceptance of the Commission’s Final 
Report, the Governor said: 

Virginia taxpayers have made a 
major investment in public higher 
education, and they undoubtedly 
will be called upon to make even 
greater investment in the future. 
The adoption of Institutional 
Performance Agreements is crucial 
to ensuring these investments yield 
tangible, measurable results in 



terms of improved academic 
quality and institutional efficiency. 
That is the hallmark of 
accountability. (“Governor 

Gilmore Receives....” January 3, 

2000) 

What the popular press, books 
critical to higher education, and 
legislation tying funding to performance 
indicators have in common are that they 
are external forces that demand change 
within higher education institutions and 
call for some form of measurable 
accountability. The clear implication is 
that higher education institutions have 
been unwilling or unable to conduct their 
enterprise in ways that meet the 
expectations of those both within and 
external to the enterprise. These external 
forces are now so strong that many 
institutions are looking for new ways to 
more effectively accomplish their vision 
and mission and to do it in a way that is 
convincing to the people, both internally 
and externally, who have a stake in the 
institution’s success. For many 
institutions this has meant adopting the 
quality tools that many businesses have 
found so successful. The problem has 
been that few, if any, of the efforts made 
by higher education institutions have 
been done with a full understanding of 
the quality process as a total system. 

The Principles of the Quality System 

Moving from Quality Control to 
Quality Process 

Early efforts to control for quality 
were based on a resource-input/output- 
inspection model. This model paid little 
attention to the process of creating a 
product but inspected for quality at the 
end of the process. This inspection 
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process had the following basic 
principles: (a) if you used quality inputs, 
i.e., quality materials and quality 
employees, and (b) your process has 
proven successful in the past, then (c) 
your end product should be of good 
quality, (d) If through output inspection 
you found unsatisfactory products, this 
was the result of input defects and not 
because of the process, (e) The way to 
improve quality was to improve inputs. 
This was done by either getting better 
quality materials or firing employees and 
hiring better employees. 

Most higher education institutions 
operate using the resource-input/output- 
inspection approach. The best resource 
available, i.e., faculty, students, library 
acquisitions, and computer labs, form the 
inputs into the teaching-learning process. 
During each class there are periodic 
inspections in the form of such evaluation 
methods as papers or tests to assess the 
quality of learning. In the end some 
students are judged to be quality students 
and are passed on to another course until 
they graduate. Students who do not pass 
inspection are required to repeat a course 
(this is called rework) or leave the 
institution (this is called scrap). Rarely is 
the failure of students considered a 
reason to reassess the teaching-learning 
process and, as a consequence, the same 
process causing student failure is 
repeated. Some institutions and faculty 
take pride in the high failure rate of their 
students and see it as an indication of the 
institutional quality. However, more 
recently, external stakeholders are 
beginning to question the quality of 
institutions that have more than 50 
percent scrap as their outputs. 

The search for a method that 
would help to produce more consistent 



quality outputs took a major turn in the 
1930. A few companies came to the 
realization that the causes of poor quality 
products or outputs were caused by flaws 
in the processes that produced these 
products. Therefore, they concluded that 
quality could be improved if these 
processes were carefully monitored and 
adjusted when found to be out of 
conformance. 

This concept was further refined 
with the understanding that there are 
processes or systems that are interrelated 
and interdependent on other processes 
and that 80 percent of problems in an 
organization are the result of process 
flaws (Chaffee & Sherr, 1992). 

The writings of Deming (1986, 
1993) Juran (1988) and Cosby (1979) 
took the understanding of quality to a 
new level of sophistication. Each helped 
to create a greater awareness that at the 
center of any process are the 
organization’s people. Therefore, process 
analysis must include the development 
and improvement of an organization’s 
people systems as well as its production 
systems. Deming, Juran and Cosby each 
created their own framework of quality in 
the form of a list of quality principles. 
However, because each of these list were 
not expressed as a total system, with each 
principle related to and dependent on the 
other principles, these lists lacked a 
conceptual framework that held all of the 
principles together. As a consequence 
when organizations began to consciously 
develop quality systems, they often 
would implement the points that were the 
easiest and ignore points that they 
thought to be too difficult. For example, 
many higher education institutions that 
were early adopters of a quality process 
focused primarily on the administration 
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side of the academy, leaving the 
academic side to its traditional ways of 
doing things. When this partial approach 
to quality systems produced only modest 
results, many institutions abandon their 
formal quality efforts. 

Missed by most people reading 
the quality literature were three concepts 
necessary for the successful 
implementation of quality: (a) Quality is 
a system of basic principles. As a 
system, if one of the parts is missing the 
entire system is affected, (b) These 
principles are interrelated, inter- 
dependent, and have an orderly cause and 
effect process. That is to say, the first 
principle must be in place for the second 
principle to work effectively, and the 
second must be in place for the third 
principle to be effective, and so forth. 
And (c) creating a quality organization is 
a fundamental change in the way one 
thinks about an organization. Quality 
systems are not a new management 
technique but a basic shift in an 
organization’s philosophy and culture. 

Eight principles of a quality 
culture that were most often identified in 
the literature were analyzed in A Culture 
for Academic Excellence: Implementing 
the Quality Principles in Higher 
Education, (Freed, Klugman & Fife, 
1997). From this analysis came an 
interrelated and interdependent system of 
quality. These principles and their 
relationships are: 

• Stakeholder Driven Vision, Mission 
and Outcomes: Since quality is 

ultimately defined by the stakeholder, 
organizations need to develop an 
internally shared understanding of its 
vision, mission and expected 
outcomes that are grounded on the 



needs and expectations of its 
stakeholders. 

• Process or System Dependent: 
Throughout an organization there 
needs to be a system perspective. At 
all levels in an organization there 
must be awareness that it is the 
systems and processes of the 
organization that determines the 
quality of its outcomes. Because 80 
percent of all organization’s problems 
are caused by system and process 
errors, individuals must know what 
are the major systems and processes 
at their level and how they affect 
other organizational systems. 

• Top-down/Bottom-up Leadership: 
Leaders need to articulate from the 
top a vision of an organization based 
on the quality values and principles 
that establishes a culture of quality, 
and hold everyone accountable to 
these values and principles. Having 
done this, then the leaders must be 
ever vigilant to ensure that the 
organization’s policies, procedures, 
especially their personnel evaluation, 
appreciation and reward systems, are 
consistent with and supportive of this 
culture. 

• Strategic and Systematic De- 
velopment of Each Individual : The 
knowledge base and skills needed in 
an organization are constantly 
changing. Organizations need to be 
conscious about the knowledge and 
skills that are currently needed to 
promote quality outcomes, regularly 
assess the knowledge and skill levels 
of each employee and require 
continuous development of everyone. 
Without ensuring that all personnel 
have the necessary knowledge and 



skills, the possibility of developing a 
quality organization is doubtful. 

Decisions Based on Fact: 
Responsive and effective decision- 
making is the result of an 
organization-wide flow of 
information and data that will allow 
decisions to be factually and 
contextually based. Since people 
value primarily what they can see and 
measure the converse is also true - 
that which is not measured, assessed 
and improved is not valued. 
Organizations must identify what is 
important and then create ways to 
constantly assess these areas. 

Internal and External Collaboration 
and Stakeholder Involvement: Since 
most decisions affect the 
organization’s mission and outcomes, 
and impact on one or more internal 
systems or processes, to have as 
complete decision making 
information as possible, the problem 
should be reviewed from a functional 
rather than a departmental point of 
view. This means including in the 
decision making process the people 
who have the most interest or stake in 
the decision. Developing a functional 
organization structure will allow for 
maximum communication between 
the stakeholders of an issue and aid in 
reaching a consensus for action in 
which all parties are committed. 

Shared Decision-Making: Effective 
decision-making occurs when those 
people, regardless of departmental 
boundaries, who are closest to the 
problem, are part of the decision 
making process. This most often 
occurs by allowing decisions to be 
made at the level where there is the 



greatest awareness of the causes of 
the problem. 

• Creating a Culture of Change: 
Change in most organizations is 
resisted out of fear that failure will 
bring retribution and rejection. An 
organization creates a culture of 
change by creating a culture based on 
the previous seven principles. When 
this occurs there develops a sense of 
trust that encourages individual to 
dare do things differently. A culture 
of change is the foundation of 
continuous improvement. 

These principles are the 
foundation for establishing an 
organizational culture of quality. Figure 
1 depicts the relationship of each of these 
principles: Vision and mission is at the 
center of an organization’s focus, systems 
hold the organization together, and each 
of the other principles connect to both the 
vision and systems of the organization 
and to the adjoining principles. Going 
clockwise within the circle, starting with 
the Leadership principle, each following 
principle is dependent on the successful 
implementation of the previous principle. 

These principles need to exist 
throughout an institution if a quality 
culture of quality is to be sustained. For 
this to happen these principles must be 
valued throughout the organization and 
be an integral part of the organization’s 
framework. The following section 
presents an example of such a 
framework. 

Organizational Framework for a 
Quality Institution 

When the principles of a quality culture 
are not imbedded in the organizational 



Figure 1 

The Principles of a Quality Culture 
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structure of an institution, the use of 
quality assessment reviews, such as the 
Malcolm Baldrige National Quality 
Award assessment process or the 
Academic Quality Improvement Project 
(AQIP) that are discussed later in this 
paper, will demonstrate the existence of 
this weakness. Leaders of organizations 
who have been successful in developing a 
quality culture have learned, mostly the 
hard way, the importance of creating 
organizational reinforcement of their 
quality values. 

Figure 2 and the following 
discussion describe a conceptualization 
of an organizational structure that 
embodies the quality principles. 

Within the concept of the quality 
principle “leadership for a quality 
culture” is the understanding that 
“quality” is not a new management 
technique but a type of organizational 
culture that is. focused on accomplishing 
an organization’s vision and mission in a 
fundamentally different way. The 
leadership for a quality culture must 
therefore be different from what currently 
is the norm in many of today’s higher 
education institutions. This leadership is 
not at the top issuing commands down 
the organization’s chain of command. It 
is at the side influencing the organization 
both from the top and from the bottom. 

Both Noel Tichy and Eli Cohen in 
their book The Leadership Engine: How 
Winning Companies Build Leaders at 
Every Level (1997) and Jay A. Conger 
and Beth Benjamin in their book Building 
Leaders: How Successful Companies 
Develop the Next Generation (1999) 
address the new leadership style that 
creates quality organizations. Quality 
organizations realize that it is the people 



of the organization that causes the 
organization to be either effective or 
ineffective. The leadership style of the 
command and control, top down, 
charismatic leader wearing the shiny 
armor and riding the white horse and 
shouting “follow-me” that dominated 
much of the first half of the 20 th century 
has given way to a much more engaged 
leader. This is the teacher-leader who 
creates a process that helps form a shared 
belief in the vision and mission of the 
organization and ensures that the policies 
and procedures are consistent with the 
organization’s vision and mission. As 
Tichy and Cohen (1997) describe this 
process: 

Teaching is at the heart of leading. 

In fact, it is through teaching that 
leaders lead others. Leading is not 
dictating specific behavior. It is 
not issuing orders and 
commanding compliance. Leading 
is getting others to see a situation 
as it really is and to understand 
what response needs to be taken so 
that they will act in ways that will 
move the organization toward 
where it needs to be. (p.57) 

The first role of leadership is to 
listen; listen to both the external and 
internal stakeholders. The external 
stakeholders, such as state legislatures 
and boards of trustees, more often will be 
pressuring for rapid change while the 
internal stakeholders, such as faculty, 
will most likely be identifying reasons 
why a slower approach to change is more 
desirable. Because higher education 
institutions have so many diverse 
stakeholders, their expectations often are 
in conflict with one another. It is the 
leadership system’s responsibility to 
create a balance between the various 
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stakeholders. Based on consideration of 
internal strengths, basic resources, and 
survival, it is the leadership system’s 
responsibility to articulate a succinct 
vision and mission that can be easily and 
vividly understood throughout the 
organization. That’s the easy part. The 
second role is to ensure that there is 
integrity throughout the organization by 
making certain that the various policies 
and procedures are consistent with and 
reinforcing of the organization’s vision 
and mission. 

The first step to system integrity 
is to create an information system or 
systems that have the following four 
characteristics: 

• The people who will be using the 
information are involved in 
identifying what information should 
be collected and how it should be 
presented. 

• The qualitative and quantitative data 
collected are presented in the context 
of the issues being considered. 

• The system has the capacity to present 
its information to all the people 
involved in a decision making 
process at the time they need the 
information. 

• With the exception of personnel 
matters, there are few, if any, 
restrictions on the availability of 
information. 

A second critical part of the 
integrity of an organization is to ensure 
that its planning and budget allocations 
are consistent with its vision and mission. 
Examples of this conflict would be 
setting the goal of having faculty present 



research papers at more international 
conferences while cutting back on 
available travel funds or creating a new 
curriculum emphasis without hiring the 
appropriate faculty. Leaders of quality 
organizations have learned the hard way 
the negative cost on motivation and 
commitment when planning and budgets 
do not adequately support the expectation 
of the organization’s leadership. 

The third part of an administrative 
support system that is necessary to 
develop in a quality organization is a 
carefully thought out human resource 
system. This is where the fourth 
principle of quality - a systematic 
investment in people - is the primary 
focus. This is also, ironically, the area 
where most higher education institutions 
have their greatest weakness. 
Traditionally an organization’s human 
resource department is primarily 
responsible for hiring, employee benefits 
programs and basic training of classified 
or non-faculty employee. In organizations 
with a quality culture the human resource 
area is concerned with the skills and 
knowledge base of every employee and 
would encompass the following steps: 

• When a staff or faculty member is 
hired, and annually thereafter, an 
assessment is made concerning his or 
her career ambitions and a plan is 
developed on how those ambitions 
can be accomplished. 

• Annually a staff or faculty member’s 
knowledge and skills are assessed and 
compared with the knowledge and 
skills needed for his or her position. 
From this comparative assessment, a 
plan is developed for knowledge and 
skill development over the next year. 
Saturn, a company noted for its 



quality organization, requires the 
documentation of 92 formal hours of 
training for everyone in the company. 
This includes groundskeepers to the 
company president. 

• The organization dedicates a 
percentage of its personnel budget for 
employee development. Winners of 
the Baldrige Award committed from 
3 to 5 percent of their personnel 
budget to employee development. 

• Since the future leadership of the 
organization is vital to its success and 
the most successful organizations 
have learned the wisdom of creating 
future leadership from within, human 
resource departments should be 
concerned with creating and 
monitoring leadership development 
programs. 

These three areas - information 
systems, planning and budget allocation, 
and human resource systems provide the 
base for institution management and 
development, which in turn provides the 
support for the rest of the institution. The 
rest of the framework represents a flow of 
work responsibilities designed to marshal 
the talents and resources of the institution 
to achieve its vision, mission and 
expected outcomes through its teaching 
and learning, scholarship and service 
activities. 

How well the organization 
performs internally will determine its 
ability to achieve its vision and mission. 
The degree to which an institution 
successfully meets its stakeholders’ 
expectations will determine the degree to 
which it will be considered a quality 
institution. 



If the principles of a quality 
culture permeate this organization 
framework, there is a greater chance that 
the 12 obstacles to the implementation of 
a quality philosophy, culture and 
techniques in an organization most often 
mentioned in the literature will not be a 
serious problem. These obstacles are 
(Salenga & Fazel, 2000): 

• An organization wide definition of 
quality that is unclear. 

• A formalized strategic plan for 
change that is imprecise. 

• A stakeholder focus that is ill defined. 

• Interorganizational communication 
that is inefficient. 

• Poorly conceived employee em- 
powerment programs. 

• Low employee trust in senior 
management. 

• Senior management that views 
quality programs as a quick fix. 

• Quality systems are seen as a way to 
achieve short-term financial results. 

• Politics and turf issues are ignored 
when implementing a quality 
program. 

• A strong motivation for the 
implementation of a quality system 
throughout the organization is absent. 

• A feeling that there is a lack of time 
available to devote to a quality 
initiative. 
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• And, a lack of serious, committed 
leadership. 

Some of these obstacles relate to 
an organization’s culture while others 
relate to management, organization and 
strategic planning issues. Most of these 
obstacles are overcome when the 
principles of quality culture are firmly 
integrated with a quality culture 
organization framework. But how can an 
institution know that this is happening? 
When an institution’s leadership is ready 
to ask this question, they are ready to turn 
to the quality assessment models for the 
answers. 

Quality Assessment Models 

National Quality Assessment Model 

In 1987, The Malcolm Baldrige 
National Quality Award (MBNQA) was 
established by the U. S. Congress to 
create a program that would encourage 
American for-profit businesses to adopt 
quality management practices and share 
their practices with other companies. In 
the early 1990s the businesses 
participating in this program realized that 
two sectors crucial to their quality efforts 
— education and health — were not eligible 
for a Baldrige Award, and therefore were 
not active participants in the country’s 
formal efforts to develop a systematic 
approach to quality. At the same time, 
several prominent education associations 
and institutions were also raising the 
same concerns. This lead to a number of 
meetings and, as a result of these early 
discussions, an education pilot project 
was developed (1994-95). In 1998 
Congress formally authorized the 
MBNQA program to offer an award for 
education. 



A Baldrige Award for education 
has the potential to change how higher 
education approaches its efforts to ensure 
that it is able to consistently achieve its 
quality objectives because it requires the 
applicant to review its performance 
against a number of values and process 
areas or categories. 

Underlying the Baldrige 

assessment process are 1 1 core values 
and concepts that embody one or more of 
the principles of quality. They are: 

Visionary Leadership — An educational 
institution’s senior leadership needs to 
anticipate and set directions that 

embodies the short- and long-term 
visions, mission and expected outcomes 
of their organization. 

Learning-Centered Education — The 

primary focus of an educational 

institution is to help students learn. 

Organizational and Personal Learning — 
Because the education environment, from 
stakeholders’ expectations to the 
knowledge base, is rapidly changing, the 
people and procedures of an institution 
need also to be learning, growing and 
continuously improving. 

Valuing Faculty, Staff, and Partners — An 
education organization needs to be 
committed to faculty, staff and partners’ 
development, and well being, and works 
to ensure the adequacy of their 
knowledge, skills, innovative, creativity, 
and motivation. 

Agility — Increasingly, if education 

institutions are to meet the expectations 
of their stakeholders they must create 
faster and more flexible responses to a 
rapidly changing education climate. 
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Focus on the Future — In the past many 
education institutions took pride in their 
long-standing traditions; today’s quality 
institutions must balance the past with the 
long-term educational needs of all their 
stakeholders. 

Managing for Innovation — One of an 
institution’s management responsibility is 
to make meaningful changes, when 
appropriate, to improve an organization’s 
services and processes and create new 
value for the organization’s stakeholders. 

Management by Fact — Most major 
decisions need to be made based on 
contextual data and information. 
Information systems need to be 
developed that will bring the needed 
information to the right people at the 
right time. 

Public Responsibility and Citizenship — 
All education institutions are social 
institutions and therefore carry a special 
responsibility of serving as a role model 
of good citizenship in all its operations. 

Focus on Results and Creating Value — A 
quality process does not mean much if 
key results are not being achieved. 
Leaders must have a balance between 
creating a quality process and effectively 
meeting their stakeholders’ expectations. 

System Perspective — Underlying the 
Baldrige assessment process is a system 
perspective for managing an organization 
and achieving performance results 
(Baldrige, 2000, pp. 2-5). 

These values that advance the 
operation of an institution, while 
fundamentally acceptable to most 
academic cultures, are rarely discussed or 
made part of systematic review. There 



seem to be two reasons for this. First, 
since these values rarely are part of the 
outcomes or results measurement of 
program or accreditation review, they 
appear not to valued as highly as those 
areas that are measured. Second, these 
values require a top-down/bottom-up 
form of leadership that is not the norm in 
most organizations. 

The Baldrige assessment process 
consists of four distinct phases, which 
could be looked as a cycle of 
improvement: an organization knows 

what it wants to accomplish, knows how 
to go about accomplishing these 
objectives, will have some measurements 
that give some indications of how 
successful it has been in doing this, and 
finally will use these measurements to 
improve what it is doing. This cycle of 
improvement is illustrated in Figure 3. 

Many organizations, and higher 
education institutions in particular, 
seeking to develop a quality culture, have 
carefully developed their approach or 
planning but wonder why they are not 
seeing results. The reason is that their 
planning has not been appropriately 
deployed or implemented. Poor 
deployment is often caused by failure to 
correctly measure a process so its 
weaknesses can be discovered and 
corrected. 

Figure 4 presents a system 
perspective of the Baldrige Education 
Criteria. While the Baldrige system is not 
depicted as a cause and effect system, 
there is a strong relationship between 
Categories. One important assumption 
made by Baldrige is that there is in place 
a strategy and action plans that are 
student and stakeholder focused. 
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Figure 3 

Cycle of Improvement 
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Figure 4 

Baldrige Education Criteria for Performance Excellence Framework: A System Perspective 





Encompassed in the Baldrige 
assessment process are the following 
relationships: 

• There is a leadership component that 
includes a strong relationship 
between the categories of leadership, 
strategic planning and a focus on 
student and stakeholder expectations. 

• Information and analysis, or 
management by fact, under grids the 
entire quality process. 

• A faculty and staff focus and careful 
management of the educational and 
support processes, combined with the 
leadership component, produce the 
organization’s results. 

• The performance of the organization 
influences the institution’s student 
and stakeholder focused strategy and 
action plan, which in turn influences 
the direction taken by the institution’s 
leadership system. This in turn starts 
the system cycle once more. 

• This quality process is a closed 
system, i.e., each category reinforces 
or diminishes the other. The end 
result is continuous improvement. 

Category 1-6 assesses issues in 
two ways: how does an organization plan 
or approach each category and how does 
it implement or deploy this planning. 
Category 7 asks the question, Now that 
you have told us how you plan for each 
category and implement this planning, 
what outcome or result data do you have 
that demonstrates you have been 
successful? 

The Baldrige assessment process 
helps examine the quality efforts of the 



entire organization while at the same time 
it provides a system approach to 
examining the process development in 
each category. 

Since the Baldrige Award was 
established, many states have 
implemented their own quality awards. 
Currently there are more than 40 states 
that have established award programs 
with some form of quality assessment 
system, most of which are modeled on 
the Baldrige assessment process and 
include education as one of their award 
categories. For higher education 
institutions, these state efforts are another 
external opportunity to create internal 
motivations to further develop their 
quality systems. 

Regional Accreditation Quality 
Assessment Model 

While many higher education 
leaders are comfortable using the 
Baldrige assessment process with the 
administrative side of their institution, 
they are reluctant to encourage faculty 
leaders to use it as part of the academic 
side of their enterprise for fear of how the 
faculty might react. This one sided 
approach to the implementation of a 
quality process and the increased external 
pressures to make institutions more 
accountable to their stakeholders have not 
gone unnoticed by the regional 
accreditation associations. 

The largest of the regional 
accrediting associations, the North 
Central Association Commission on 
Institutions of Higher Education 
(NCACIHE) spent 1999-2000 developing 
their own quality assessment process. 
This process, called the Academic 
Quality Improvement Project (AQIP), 
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differs from the Baldrige process in that 
it is designed to specifically address the 
needs of higher education institutions to 
implement as well as assess their quality 
efforts. AQIP stresses values and 
categories that are similar to Baldrige but 
are expressed more within the values of 
an academic culture. Where AQIP 
significantly differs from Baldrige is that 
it asks for result assessment in each 
category. Also, unlike the Baldrige 
program, NCAGIHE also is taking a very 
active role in helping institutions 
implement the AQIP process. NCACIHE 
has depicted the AQIP process in their 
first brochure (North Central Association, 
2000, p. 9) as seen in Figure 5. 

This representation is more of a 
linear conceptualization of the AQIP 
process. The Criterion that drives the 
process is “Understanding Students and 
Other Stakeholders’ Needs." The second 
group are the process Criteria: Valuing 
People, Leading and Communicating, 
Supporting Institutional Operations, 
Planning Continuous Improvement, and 
Building Collaborative Relationships. If 
these processes are effectively 
implemented, then the third set of 
Criteria: Helping Students Leam, and 
Accomplishing Other Distinctive 
Objectives, will be effectively achieved. 

Underlying all these categories is 
the Criteria: Measuring Effectiveness. 
Like Baldrige, AQIP believes that an 
organization can achieve effectiveness 
only when it continuously measures what 
it is doing with the purpose that these 
measurements are used to improve or 
make more effective the process(es) or 
system(s) that are being measured. 
Therefore this Criterion under girds all 
the other Criteria. 



What is not represented in the 
AQIP and the Baldrige quality Criteria 
and Categories is a cause and effect 
interaction (see Figures 4 and 5). For the 
Baldrige representation, it is assumed that 
institutions already have a well defined 
“Student and Stakeholder Focused 
Strategy and Action Plan." This 
assumption is not made by AQIP. 
Baldrige first groups its process Criteria 
into a Leadership group: (1) Leadership, 
(2) Strategic Planning and (3) Student 
and Stakeholder Focus. These leadership 
criteria interact with the second set of 
internal process criteria, (5) Faculty and 
Staff Focus and (6) Educational and 
Support Process Management, all of 
which are supported by data and 
information assessed through Criteria 4: 
Information and Analysis. The impact of 
these processes is measured in Criteria 7: 
Organizational Performance Results. 
While this diagram fairly represents the 
Baldrige assessment process, it does not 
represent a system or cause and effect 
diagram for implementing a quality 
process. 

Figure 6, presents the AQIP 
process in a cause and effect or closed 
system interaction system. 

Unlike the more linear 
representation presented in Figure 5, 
Figure 6 depicts the AQIP Criteria in a 
closed system with cause and effect 
interaction. Most systems are closed in 
the respect that each action affects some 
other part of the system or another 
interrelated system, which in turn impacts 
on other parts of the system, until the 
results of that first action is felt on that 
part of the system where the action first 
took place. Unless there is an action to 
intervene, the results of an action, 
modified by interaction with other parts 
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Figure 5 

NCA AQIP Quality Criteria Framework 
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Academic Quality Improvement Project 
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of the system will continue to have 
impact on the system. 

For the AQIP quality process 
there are three Criteria that impact all the 
other Criteria all of the time. They are: 
Understanding Stakeholders’ Needs, 
Leading and Communication, and 
Measuring and Tracking Effectiveness. 
A quality organization must understand 
its stakeholders’ needs in order to create a 
clear sense of vision and mission; its 
leadership must constantly communicate 
the vision and mission and ensure 
internal process consistency; and 
decisions need to be based on contextual 
measurement of the various processes. 
These Criteria influence the cause and 
effect relationships between the four 
internal Criteria, Supporting Institutional 
Operations, Valuing People, Planning 
Continuous Improvement, and Building 
Collaborative Relationships that 
ultimately results in the outcomes 
Criteria of AQIP, Helping Students Leam 
and Accomplishing Other Distinctive 
Objectives. 

The cause and effect relationships 
work in these ways. Within the Criteria 
of Supporting Institutional Operations are 
many different systems. If these systems, 
made up of the policies, procedures, and 
people that interact with the rest of the 
institution, are consistent with the quality 
values of the organization then there will 
be a sense of integrity between the 
organization’s leadership - those who are 
promoting a quality organization - and 
the people in the rest of the organization, 
which will create a sense that the 
organization values its people. This in 
turn will foster a culture of trust that will 
make it possible to build collaborative 
relationships that, in turn, will work to 



maintain and improve the impact of the 
supporting institutional operations. With 
the positive results of these three Criteria 
reinforcing each other, it makes it 
possible for the quality principle of a 
culture of change to exist that makes the 
Criteria of Planning Continuous 
Improvement possible. The sum result of 
these seven criteria makes it possible for 
an institution to achieve its vision and 
mission in regard to ensuring the success 
of the two outcome Criteria: Helping 
Student Leam and Accomplishing Other 
Distinctive Objectives. 

Baldrige and AQIP are only two 
of several quality assessment systems 
that are used by organizations to evaluate 
the quality of their organization, ensure 
that they are consistently moving towards 
the accomplishment of their vision and 
mission, and are continuously improving 
their processes and systems. These 
assessment systems are very helpful tools 
for a higher education institution to use to 
make certain that the quality it thinks it 
has really is what is represented by its 
outcomes and to identify new ways to 
improve what it wants to accomplish. 

Conclusion 

The individual concepts that make 
up the principles of quality are not new. 
They have been around for decades and 
in some respect, all are practiced within 
an organization. What is new and what 
makes the principles of quality so 
powerful are three significant differences: 

• First, is the concept that for an 
organization to be successful it must 
understand the expectations of its 
stakeholders. For an organization to 
be considered high quality, it must 
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always meet or exceed its 
stakeholders’ expectations. 

• Second, is the understanding that all 
the parts of an organization are part of 
interrelated and interdependent 
systems that exist to help the 
organization achieve its vision and 
mission. If the systems and processes 
within an organization lose their 
stakeholder focus then the 
organization will fail to meet its 
mission. This is also true if the people 
in the various systems fail to 
understand how they are interrelated 
and interdependent to the other 
systems of the organization. To the 
degree any one system fails to 
understand how it can negatively 
affect the other systems of the 
organization, an organization will be 
less effective in achieving its mission. 
This is also true in the 
implementation of the individual 
principles. When an individual 
principle, such as collaboration, is not 
implemented in conjunction with the 
vision and mission of the institution 
and becomes an end unto itself, it 
becomes dysfunctional in helping 
achieve the mission of the 
organization. 

• And third, is the understanding that 
the principles of a quality culture 
have a cause and effect relationship. 
For every principle that is weak, all 
the following principles will be 
weaker. For example, it is not 
possible to develop effective 
information systems without first 
ensuring that faculty and staff have 
the knowledge and skills to help build 
and then contextually use these 
information systems. 



Assessment activities such as the 
Malcolm Baldrige National Quality 
Award Program, the state quality award 
programs, and to some extent, the 
Academic Quality Improvement Project 
of the North Central Association 
Commission on Institutions of Higher 
Education have a common purpose - to 
assess how successfully an organization 
has been in infusing into their 
organizational culture the principles of 
quality. 

One way to achieve a culture of 
quality is to rethink and reorder an 
organization’s organizational chart from 
an authority or department form, i.e., who 
reports to whom, to a functional form. 
By stressing a functional operation, the 
organization leaders are continuously 
reinforcing the interrelationships between 
the principles of quality and the various 
systems of the organization as they work 
to achieve the mission of the institution. 

Before entering into the very 
challenging task of ensuring a culture of 
quality in an institution, leaders should 
first ask themselves, “Is there evidence 
that systems of quality have made a 
significant difference?” The staff of the 
Baldrige Award Program also asked that 
question. To find an answer they asked a 
second question, “What is one of the 
missions of a for-profit business?” The 
answer is bringing a fair, long-term 
return to their stockholders. To answer 
the first question they track the stock 
growth of every Baldrige winner. The 
Baldrige staff then reviewed the stock 
return of Baldrige winners since 1988. 
The result is that, as a whole, the stock of 
Baldrige winners have exceed the growth 
in the Standard and Poor 500 Index by 
more than 200 percent. If for-profit 
companies can have this result in 
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achieving their mission, it is very likely 
that a higher education institution can use 
the same principles to achieve it mission 
(Results of. 2000). 

Other questions that leaders might 
ask themselves are: "Is there more 
satisfaction in leading an organization 
that is meeting its mission than one that is 
not?” “Is there more pleasure in leading 
an organization that is based on trust and 
openness that creates goodwill 
throughout the organization?” “Is there 
more inward sense of personal 
accomplishment knowing that tuition 
fees, public and private financial support, 
and research grant monies are well spent 
because there is an organization wide 
focus on meeting stakeholders’ 
expectations?” If the answers are yes, 
then it is time to assess how well are the 
principles of quality an integral part of 
the organizational culture and what needs 
to be done to ensure their continuous 
development. 
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These are interesting times in 
higher education - very interesting times. 
And, as is so often the case, when the 
Confucian wish does come true, it is 
quite unsettling. In our industry - a new 
term that itself is discordant to many - 
change now approaches the center of how 
things “have always been done.” The 
ways in which information has been 
imparted, with a wise person speaking to 
one learner (or even 200) supported by 
printed materials, have been abruptly 
modified. Instruction is now “mediated;” 
learning is “asynchronous;” knowledge is 
“virtual;” and technology is everywhere. 
We are a long way from the simplicity 
and directness of having Mark Hopkins at 
one end of the log and a student at the 
other. 

Today, the log is wired for e-mail 
and more, and computers are ubiquitous 
at nearly every American college and 
university. Spirited arguments about 
divisions between academic and 
administrative computing have been 
swept away under the rubric and ideas of 
“information technology,” and at most 
schools, administrators despair about 
how to pay for everything that will surely 
come next. As a small example, when I 
arrived at Manchester just over six years 
ago, a major decision on the docket was 
the purchase of a second fax machine for 
the College, and it had opponents! 
Today, we rank high in Wired 
magazine’s listing of schools that do 
especially well in providing computer 



access and services; we have made a 
major investment in academic 
computing; and I have absolutely no idea 
of how or where we found all of the 
funds for this investment, or how we will 
support what we must do in the future. 

At the same time, and in 
approximately the same six years, other 
challenges have emerged. Some are the 
direct result of technology. Others come 
from a changing business environment 
(itself shaped in part by new 
technologies) in which many have 
concluded, correctly, that there is money 
to be made in higher education. 
University Business is the hottest new 
publication in our industry, and most 
faculty can now hear words like 
“marketing,” “customer service,” and 
“efficiency” without becoming 
apoplectic. The Chronicle of Higher 
Education 's section on information 
technology grows larger, and its pages 
are filled with advertisements for new 
ways in which to instruct. The 
University of Phoenix and its for-profit 
competitors are hot, growing, and 
aggressive. Their hyper-efficiencies are, 
in the very special vocabulary of 
traditional higher education, “scary as 
hell.” 

There is also the matter of size. 
The enterprise of higher education has 
grown larger, both in numbers and in its 
concentration. The University of 
Phoenix, for example, is today a school 



of 60,000 students (with only 60 full-time 
faculty) and will grow larger. Some of 
our great state universities approach truly 
mega-enrollments. For example, the 
University of Texas, the Ohio State 
University, and the University of 
Minnesota each have student populations 
(FTEs) of nearly 50,000 students. 

Perhaps the best way to 
understand size in higher education 
would be to look for examples of 
revisionist history, where the “ideal size” 
of colleges or universities, especially 
universities, has been recalculated and 
reworded. It would be a simple exercise, 
first to find the schools since over recent 
decades many have grown larger, and 
larger still, on a number of occasions 
smashing through stated ideals for size; 
and then to look for rhetoric abandoned. 
Emphasis could be given to what had 
been said about the optimal size for the 
best student experience — arguments now 
left well behind. 

Technology. Efficiency. Size 
(or, more exactly, an imperative for 
growth). Individually, and in their 
interrelationships, changes here affect 
every college and university because of 
what they or their competitors 
accomplish. Those in denial are in the 
greatest jeopardy. 

Such challenges reach to the very 
heart of the industry. New 

understandings of intellectual property 
are emerging, and it is quite possible that 
university scholars and scientists will not 
own what they create. Teachers will also 
need to negotiate how their courses are 
used by others. Actually, the threat here 
may be even greater. Only 25(!) college 
courses enroll 50 percent of all student 



credits, and “killer courseware” is being 
developed for each one. 

While entrepreneur Michael 
Saylor’s plans are on hold because of the 
recent downturn in the dot.com market, 
and the loss of $6 billion by his software 
company, Micro-strategy, his proposal to 
invest $100 million in an Internet 
university that would provide a free 
college education to “everyone, 
everywhere” needs to be taken seriously, 
both for its immodesty and the whiff of 
real possibility. And, watch Andy 
Rosenfeld’s company, UNext, which is 
proposing an entirely new way of 
teaching over the Internet. Reportedly, 
Columbia University, as the first major 
university investor, receives $20 million 
if UNext fails! H. and five percent of the 
profits if UNext succeeds. 

Add big-time college athletics 
with its excesses and profits, with the 
market for sports logo-wear alone 
exceeding $3.5 billion (and much of it 
based on sweatshop labor overseas 
which, in turn, raises its own issues); and 
stir in the changing character of 
employment in higher education with the 
move to more and more part-time 
academic jobs. The times become even 
more “interesting.” 

Core Issues in Quality: Schooling 
versus Education 

All of these things, and many 
others, press on educational quality. 
Even those persons concerned with 
quality — and I think that we can fairly 
argue that in the interests of profit, or 
even efficiency, not everyone is 1 - often 



1 This is not to bash the legitimate efforts to 
educate students that may also make a profit. 
Some are now accredited by the same 
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